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(54) System and method for encoding digital information in a television signal 



(57) Digital information (101) is encoded in the video 
portion of a television signal (107) such that "n u (n is an 
integer) bits of the digital information are carried by each 
successive frame in a group of frames. The digital infor- 
mation is encoded by modulating a carrier signal (1 03), 
using, for example, either amplitude shift keying (ASK) 
( 1 03. 1 1 1 ) or frequency shift keying (FSK) ; and the mod- 
ulated carrier is then added (115) to the video signal 
(107) selectively, only in portions of .the television pro- 
gram that (a) are not likely to be perceptible by a viewer 
and (b) are of sufficient intensity to transmit the data. 
The video signal including the encoded digital data, may 
be transmitted ( 1 1 4) Jn real time, to a television receiver, 
or recorded (112) for later playback. In either event, at 
a receiver, when the video signal containing the encod- 
ed information is displayed on a screen, the image is 
sensed or "viewed 11 by a photo detector, the output of 



which is applied to a band pass filter having a center 
frequency that corresponds to the oscillator frequency 
(s) (113) in the encoder. The filter output is threshold or 
FM detected, so that the receiver can recover the en- 
coded data. By appropriately including checks bits and 
synchronization patterns, the bit stream output from the 
decoder can be synchronized, and the original encoded 
data recovered. Advantageously, the frequency of the 
oscillator in the ASK or FSK encoder is chosen so that 
the energy added to the video signal is in a portion of 
the frequency spectrum that otherwise contains little en- 
ergy. This makes the added digital data imperceptible 
to a viewer. If desired, the same data may be repetitively 
encoded in several groups of frames, so as to increase 
the redundancy and thus the reliability of the overall sys- 
tem. 
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Description 
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by consideration of the following detailed description, 
which should be read in light of the accompanying draw- 
ing in which : 

Fig. 1 is a block diagram of an encoder arranged in 
accordance with the principles of the present inven- 
tion, to add ASK encoded data to a video signal: 
Fig. 2 is a diagram illustrating the wave form of the 
video signal, in the time domain, with one bit of ASK 
encoded information added to a series of succes- 
sive frames of the video signal: 
Fig. 3 is a diagram similar to Fig. 2, but illustrating 
the wave form when n=2, so that two ASK encoded 
bits are added to each successive video frame: 
Fig. 4 is a block diagram of a receiver/decoder 
arranged in accordance with the principles of the 
present invention, to recover the ASK encoded data 
from the video signal: and 

Figs. 5, 6 and 7 are diagrams similar to Figs. 1. 3 
and 4, respectively, but showing the use of FSK 
encoding and decoding, rather than ASK. 

Detailed Description 

Referring first to Fig. 1 , there is shown a block dia- 
gram of an encoder arranged in accordance with the 
principles of the present invention, to add ASK encoded 
data to a video signal The encoded data to be added 
to the video signal is generated by a digital data source 
101 . which can be a computer or other device which en- 
codes text, numerical information, or other information 
as a digital bit stream in such a manner that the intelli- 
gence can be recovered in a decoder to which the same 
bit stream is applied. The output from data source 101 
is applied to the data input 1 02 of a first-in, first-out buffer 
103, which is part of an ASK encoder 106, and held in 
buffer 103 until a clock signal is applied to the buffer on 
line 104. In this embodiment, it is assumed that one bit 
of ASK encoded data is added to each successive frame 
of a video signal. It is to be understood, however that 
as explained below, n bits of information can be added 
to each frame with a small modification to the arrange- 
ment of Fig. 1 . 

A video source 107 generates the video signal to 
which the ASK encoded data is to be added. To assure 
that the ASK signal is superimposed at an opportune 
time with respect to the content of the video program, 
such that the effect of the added signal is minimally dis- 
cernible, the output of video source 107 is applied to a 
video display device 108, which may be a standard tel- 
evision or monitor. At the opportune time, such as when 
the television program is of sufficient intensity to trans- 
mit the data and when the scene does not contain any 
pattern that would generate a frequency component that 
is close to, and thus could interfere with, the frequency 
of the ASK signal to be added to the video signal, an 
enable signal is applied to one input 117 of AND gate 
105. The second input to gate 105 is derived from the 
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output of a video synchronizer 109, to which the video 
signal from video source 107 is also applied. 

Video synchronizer 1 09 is arranged to produce out- 
put pulses that are synchronized with, and that occur in 

5 timed relation with, each frame of the video signal output 
from video source 107. As long as the enable signal on 
line 1 1 7 is high, these synchronization pulses (generally 
at 60 Hz) are passed through gate 105 and applied to 
the clock input of buffer 103 on line 104. This causes 

10 the information in buffer 103 to be read out, one bit per 
frame and in synchronization with the frame, and ap- 
plied to the control input of a switch 111. Switch 1 1 1 may 
be a flip-flop or other similar element, arranged to be 
closed when a "1" is output from buffer 103 and to be 

'5 open when a "0" is output from buffer 1 03. 

Oscillator 113 in ASK encoder 106 is arranged to 
generate a carrier signal or tone at a predetermined fre- 
quency (such as 25kHz) that is generally indiscernible 
when added to a video image, and apply its output to 

20 switch 111. This carrier signal is applied to switch 11 1 : ^ 
the state of which is controlled by the output from buffer 
103. In this way, the output of switch 111 is an ASK en- 
coded version of the digital information from data source 
101 . The ASK encoded signal output from switch 1 1 1 is 

25 applied to one input of a mixer 115, the other input of 
which is obtained from video source 107. Accordingly, 
the ASK signal is mixed with, or added to, the video sig- 
nal. 

The result of the arrangement illustrated in Fig. 1 is 

30 that ASK encoded data from source 101 is added, on a 
frame by frame basis, to the video signal from video 
source 107. Synchronization is provided by synchroniz- 
er 109, so that the ASK encoded data is added in the 
same portions of successive frames. The output of mix- 

35 er 115 may be displayed immediately on a display de- 
vice 1 1 0, which may be a television, or stored in a video 
storage device 112 such as a video cassette recorder, 
for later use,. or applied to a transmitter 1 1 4 for broadcast 
to remote receivers. Control is provided by the enable 

-to signal on line 1 1 7 so that the ASK encoded signal is add- 
ed to the video signal only in the appropriate portions of 
the video program. Note here that the amplitude of the 
video signal corresponds to the luminance or intensity 
component, while the phase of the video signal corre- 

15 sponds to the chrominance component. Accordingly, 
the present invention is desirably arranged to modulate 
only the amplitude of the video signal. 

The encoding process for particular digital informa- 
tion is completed when all of the data in buffer 103 has 

so been read out. If desired, the encoding process for the 
same data may then be repeated, using an additional 
group or series of frames. Repetition may be desirable 
in order to increase the redundancy and thus the relia- 
bility of the overall system. Typically, digital information 

55 for a particular message, which may correspond to an 
advertisement or television commercial, may consist of 
several hundred bytes of information, containing a few 
thousand bits of information. If n=5, and the frame rate 
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is amplified in an amplifier 403 and applied to a band 
pass filter 405 tuned to the frequency of oscillator 113 
in the encoder of Fig. 1 . The output of band pass filter 
405 is applied to a threshold detector 407 that is adjust- 
ed to detect the difference in signal strength between s 
frames containing energy at the frequency of oscillator 
1 1 3 and frames that do not contain such energy. In one 
typical arrangement, amplifier 403 had a gain of 60 dB, 
filter 405 had a pass band of 1 kHz, and detector 407 
was implemented using a diode detector. io 

Figs. 5, 6 and 7 are diagrams similar to Figs. 1, 3 
and 4 ; respectively, but illustrate the use of an FSK en- 
coder rather than an ASK encoder. For convenience, the - 
same reference designations have been included for 
components performing similar functions, and only the is 
differences from the previously described figures will be 
discussed. 

In Fig. 5, oscillator 51 3 in FSK encoder 506 is ar- 
ranged to output first or second different output frequen- 
cies f-| and f 2 , depending upon the value, i.e., T or "0" 20 
of the digital data output from buffer 103. As before, syn- 
chronization is obtained from synchronizer 109, and 
used to clock data from buffer 1 03 that is used to control 
the output of oscillator 513. Switch 511 receives a con- 
trol input from AND gate 105, and therefore allows the 25 
output of oscillator 51 3 to pass to mixer 11 5 for combi- 
nation with the video signal from video source 107, only 
when the output from AND gate 105 is high. In this way, 
as shown in Fig. 6, the FSK signal output from switch 
51 1 is combined with the video signal such that during 30 
at least a portion of each frame, a component at frequen- 
cy f, or a component at frequency f 2 (depending upon 
the digital data in the buffer) is added to the video signal. 
If multiple bits are to be encoded in each frame interval, 
FSK encoder 506 may be arranged to generate an out- 35 
put with more than two frequencies. In the receiver/de- 
coder shown in Fig. 7, threshold detector 407 is replaced 
by an FM receiver 707 that is arranged to discriminate 
between the two (or more) FSK frequencies generated 
by oscillator 513 that were added to the video signal, -to 
thereby recovering the digital data. 

Persons skilled in the art will appreciate that various 
modifications and adaptation of the present invention 
will be possible, and accordingly, the invention should 
be limited only by the appended claims. For example, a -*5 
phase shift keyed (PSK) encoder could also be em- 
ployed to incorporate digital information within the video 
signal. In such an arrangement, a PSK decoder would 
be used in the corresponding receiver. 

so 

Claims 

1 . A system for communicating digital information in a 
video signal, comprising 55 

an encoder arranged to add a carrier signal 
modulated by digital information to said video 



signal, and 

a receiver arranged to optically sense said 
video signal and to recover said encoded digital 
information in said video signal. 

2. The invention defined in claim 1 wherein said carrier 
signal is modulated using amplitude shift keying 
(ASK), frequency shift keying (FSK), or phase shift 
keying (PSK). 

3. The invention defined in claim 1 wherein said carrier 
signal containing said digital information is added 
to said video signal such that said digital information 
is not likely to be perceptible by a viewer. 

4. An encoder arranged to encode n bits of digital - 
information in each successive frame of a video sig- 
nal, comprising 

a buffer for storing said digital information, 
means for obtaining a synchronization signal 
synchronized with the frame rate of said video 
signal. 

means responsive to said synchronization sig- 
nal for generating a modulated carrier signal 
during each frame interval, said modulated car- 
rier signal being formed by controlling the out- 
put of an oscillator in accordance with the value 
of the next n bits from said buffer, and 
means for combining said modulated carrier 
signal with said video signal. 

5. The invention defined in claim 4 wherein the fre- 
quency of said oscillator is chosen so that the 
energy added to said video signal is in a portion of 
the frequency spectrum that otherwise contains lit- 
tle energy, so that said digital information is imper- 
ceptible to a viewer. 

6. A receiver arranged to recover n bits of encoded 
digital information included in each successive 
frame of a video signal : comprising 

a photo detector responsive to the picture gen- 
erated by said video signal, 
means for amplifying the output of said photo 
detector, 

means for filtering the output of said amplifying 
means to isolate components at a particular fre- 
quency, and 

means for applying the output of said filtering 
means to a decoder to recover said encoded 
digital information. 

7. A receiver, including 

a photo detector for viewing a television signal 
display containing encoded information mixed 
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FIG. 4 
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(54) System and method for encoding digital information in a television signal 



(57) Digital information (101 ) is encoded in the video 
portion of a television signal (107) such that "n" (n is an 
integer) bits of the digital information are carried by each 
successive frame in a group of frames. The digital infor- 
mation is encoded by modulating a carrier signal (103), 
using, for example, either amplitude shift keying (ASK) 
(103,111) or frequency shift keying (FSK), and the mod- 
ulated carrier is then added (115) to the video signal 
(107) selectively, only in portions of the television pro- 
gram that (a) are not likely to be perceptible by a viewer, 
and (b) are of sufficient intensity to transmit the data. 
The video signal including the encoded digital data, may 
be transmitted (114), in real time, to a television receiver, 
or recorded (112) for later playback. In either event, at 
a receiver, when the video signal containing the encod- 
ed information is displayed on a screen, the image is 



sensed or "viewed'' by a photo detector, the output of 
which is applied to a band pass filter having a center 
frequency that corresponds to the oscillator frequency 
(s) ( 1 1 3) in the encoder. The filter output is threshold or 
FM detected, so that the receiver can recover the en- 
coded data. By appropriately including checks bits and 
synchronization patterns, the bit stream output from the 
decoder can be synchronized, and the original encoded 
data recovered. Advantageously the frequency of the 
oscillator in the ASK or FSK encoder is chosen so that 
the energy added to the video signal is in a portion of 
the frequency spectrum that otherwise contains little en- 
ergy. This makes the added digital data imperceptible 
to a viewer. If desired, the same data may be repetitively 
encoded in several groups of frames.. so as to increase 
the redundancy and thus the reliability of the overall sys- 
tem. 
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